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Abstract 

In this paper, we reveal the branching structure for a non-homogeneous random walk with bounded 
jumps. The ladder time Ti, the first hitting time of [1, oo) by the walk starting from 0, could be 
expressed in terms of a non-homogeneous multitype branching process. As an application of the 
branching structure, we prove a law of large numbers of random walk in random environment with 
bounded jumps and specify the explicit invariant density for the Markov chain of "the environment 
viewed from the particle" .The invariant density and the limit velocity could be expressed explicitly 
in terms of the environment. 
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1 Introduction 

1.1 Background 

We study random walk {X„} with bounded jumps in this paper. More precisely, let A = {—L, i?}/{0}. 
At position x the walk jumps with probability ujx{l) to x + I for ^ G A. Of course, X^igA'^^O ^ ^ ^^'^ 
U!x{l) > 0, / 6 A. We call {A„} the (L-R) random walk hereafter. 

Let Ti be the time the walk hits the positive half line (0, oo) for the first time. As we know, it 
is a fundamental task to characterize Ti, which plays an important roles in studying the (L-R) random 
walk, for example, the recurrence vs transience, law of large numbers, central limits theorem and large 
deviations principle et al. 

Indeed, for Ti, even some simple questions are difficult to answer. For example, what is the distribution 
of Ti? Or further, what are the moments of Ti. 

For some simple setting, these questions are known but are open for some more general setting. 

For simple random walk, that is, L = R = 1 and cjxi^) = 1 ^ i^xi^) = P G [0, 1] for all a; G Z. The 
distribution of Ti could be find by Reflection Principle. We refer the reader to Strook [6] (2005) for the 
specific calculation. 

For (1-1) random walk with non-homogeneous transition probabilities, that is, uJx depends on x, it has 
been revealed in Kesten-Kozlov-Spitzer [5] (1975) that Ti could be expressed in term of a non-homogeneous 
Galton- Watson branching process. This fact enables them to prove a nice stable limit theorem for nearest 
neighbor Random Walk in Random Environment (RWRE hereafter). If max{L, i?} > 1, that is, for the 
non- nearest neighbor random walk, things get very different. 
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For (L-1) random walk, Hong- Wang [3] (2010) revealed its branching structure, that is, Ti could 
be express by a multitype (i-type) branching process. Using the branching structure. Hong- Wang also 
proved a stable limit theorem, partially generalizing the results, for (1-1) RWRE, of Kesten-Kozlov-Spitzer 
[5] (1975) to (L-1) RWRE which is supposed to be transient to the right. 

One may ask naturally what the branching structure for (1-R) random walk is. This question is 
answered in Hong-Zhang [3] (2010). The authors decomposed the random walk path to revealed that Ti 
for (1-R) random walk could be expressed by a non- homogeneous (1 + 2 + ... -I- i?)-type branching process 
and by this fact they also proved a law of large numbers for (1-R) RWRE by a method known as "the 
environment viewed from particles" . 

One should note that, both the above mentioned [3] and [3] treat the case min{L, R} = 1. The walk 
is requested to be nearest neighbor at least in one side. The main purpose of this paper is to consider 
the general situation: min{L, i?} > 1. We restrict ourselves to L = R = 2 to explain the the idea. We 
reveal the intrinsic branching structure within the (L-R) random walk and give some applications. 

Next we define the precise model of (L-R) random walk. 

1.2 The model 

Fix L,R > 1. Set A = {— L, i?}/{0}. For i £ Z, let uji = {uji{l))i^A be a probability measure on 
i + A, that is X]ieA'^i(0 = 1j ^^'^ i^iiO ^ for all I G A. Set oj = {uJi}i^z, which will serve as the 
transition probabilities of the random walk. Let {Xn}n>o be a Markov chain with initial value Xq = x 
and transition probabilities 

Puj{Xn+i = i+j\Xn = i) = oj,{j), j e A. 

We call {A'n} the (L-R) random walk with non-homogeneous transition probabilities. Throughout this 
paper, we use to denote the law induced by the random walk 

In the remainder of the paper, in order to avoid the heavy notations, we consider the case L ~ 2, R ~ 2, 
that is, the (2-2) random walk. The idea for treating the general (L-R) random walk is basically the same 
as (2-2) setting. Also except otherwise stated, we always assume the random walk starts from 0. 

For the above defined (2-2) random walk {Xn}, set Tq = and define recursively 

n = mt[n > : Xn > Xt,_,] 

for fc > 1. We call the stopping times Tfc, fc > 1, the ladder times of the random walk. 
Especially one sees by the definition that 

Ti = inf [?i > : X„ > 0] 

is the hitting time of [l,oo) by the walk, and Xt^ is also a random variable with two possible values 
X-Ti = 1 or Xti = 2. This is the reason why we call T/^, k > 1, the ladder times. The distribution of Xti, 
the exit probabilities of the walk from (— cxd, 0], is also a question we concern below. 

The main purpose of this paper is to count exactly how many steps the walk spends to exit successfully 
from (— oo, 0] (the total steps of the walk before Ti.) and give some applications. Next we state the main 
results. 

1.3 The main results 

In order to count exactly the steps of the walk before Ti, we define three types of excursions. 
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Definition 1.1 

a) We call excursions of the form {Xk — i, Xk+i = i — 1, Xk+2 < * ^ 1, Xk+i < i — 1, X^+i+i > i} 
type- A excursions at i. Corresponding to the three kinds of possible last step of type- A excursions at i, 
say, {i — 1 — > i}, {i — 2 ^ i} and {i — 1 — S> i + 1}, we classify type-A excursions at i into three sub-types 
A,i, A, 2 and Ai^3. 

b) We call excursions of the form {X^ — i, Xk+i = i — 2, Xk+2 ^ * — 1, ^k+i £ * — 1, Xk+i+i > i} 
type-B excursions at i. Corresponding to the three kinds of possible last step of type-B excursions at i, 
say, {i — 1 — > i}, {i — 2 — > i} and {i — 1 ^ i + 1}, we classify type-B excursions at i into three sub-types 
Bi^i, Bi^2 and Bi^. 

c) We call excursions of the form {Xk = i + Xk+i = i — 1, Xk+2 < 1, X^+i < i — 1, X^+i+i > *} 
type-C excursions at i. Corresponding to the three kinds of possible last step of type-C excursions at i, say, 
{i — 1 — !• i}, {i — 2 — > i} and {i — 1 ^ i + 1}, we classify type-C excursions at i into three sub-types Ci^i, 
Ci^2 and Ci,3. 

A, 1 A, 2 A, 3 ^i, 1 Sj, 2 ^i, 3 1 Ci^ 2 3 




i-3 

Figure 1. The figure illustrates type A, B and C excursions at i. 
We draw only the first step and the last step, omitting all things 
between these two steps. Between these two steps, the walk walks 
below i — 1. 

Define 

Ai,j = H^{Ai.j excursions before Ti}, 
Bi.j = ^{Bij excursions before Ti}, 
= iflCi^j excursions before Ti}, 
for i < and j = 1, 2, 3, where "#{}" means the number of the elements in some set. 
We aim at counting exactly all steps by the walk before Ti. For this purpose, define 

Ui = {Aii,Ai2,Ai3,Bii,Bi^2,Bi^3,Ci^i,Ci^2,Ci^3), (1) 

being the the total numbers of different excursions at i before time Ti. Then we have the following fact. 

Theorem 1.1 Suppose that \iinswp„_^^Xn = oo. Then 

Ti = l + ^t/,(2,2,l,l,l,0,2,2,lf, (2) 
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where for vector v G M^, v"^ denotes the transposition of v. 
The proof of Theorem 11.11 will be given in Section |4] below. 

Remark 1.1 Because the (2-2) random walk we considering is non-nearest neighbor, one can not give 
the exact distribution of Ti in general. But we find in this paper that the process {C/i}i<o defined in (QP 
is a non-homogeneous multitype branching process. This fact together with (0) enables us to study Ti by 
the properties of branching processes. 

We attach first an ancestor to the branching process. The walk starts from 0. But before Ti, there is 
no jump down from above 1 to by the walk. One can imagine that there is a step by the walk from 
1 to before it starts from (One can also imagine that this step is from 2 to 0. But this makes no 
difference.), that is, set X^x — 1. Adding this imaginary step, the path = l,^o = 0,Xi, ...^Xt^} 

forms a type-^ excursion at 1 such that with probability 1, 

^1,1 + M,2 + = 1- 

Then one defines Ui as in ([T}. But since there is no Bij and Cij, j = 1,2,3, excursions, Ui has only 
three possible values, that is, Ui = ei, Ui =62 or Ui =63. 

We can treat Ui as some particle immigrates in the system and call it "immigration" throughout. 

Theorem 1.2 Suppose that limsup„_).j^ X„ ~ 00. Then {Ui}i<i is a 9-type non-homogeneous branching 
processes with immigration distribution as in {14^ , hi 5]) and ilOjl below, and offsprings distributions as 
in (HfM, WMM), WMEB and ^3Ul^ below. 

The proof of Theorem 11.21 will be given in the long Section |3] below. 

Remark 1.2 1) While u!i{—2) ~ for all i ^"L, Theorem \1.2\ reveals the branching structure of (1-2) 
random walk and while uJi{2) = for all i G Z, Theorem \1.2\ reveals the branching structure of 
(2-1) random walk. Therefore the branching structure in Theorem \1.2\ contains both the branching 
structures of Hong-Wang and Hong-Zhang J^. For the details, see Remark \4. 1\ below. 

2) The authors found that, one could simplify the branching structure. In fact, a 6-type branching 
process is enough to count exactly all steps by the walk before Ti. However we still use a Si-type 
branching process, since it is more understandable and each of the 9 types of particles corresponds 
to specific jump of the walk. For details, see also Remark \4.1\ below. 

We give an example to test the branching structure (the above Theorem 11.11 and Theorem ll.2p in Section 
[SJ We consider the degenerated ut, that is, for all i G Z, uji{l) = pi, uJi{2) = p2, Wi(— 1) = qi and 
uJi{-2) = q2 with pi + P2 + 91 + 92 = 1, Pi,P2,qi > and 92 > 0. In this case, let 

( qi+q2 P1+P2 P2 
92 92 92 

1 

1 

Suppose that E^(Xi) = Pi + 2p2 — qi — 2q2 > implying that lim„_j.oo Xn = 00 and let /, g, h be the 
three eigenvalues of M such that |/| > |g| > \h\. Then we show that 

P°(Xt, =l) = l + h and P^iXT, =2) = -h, 
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where h < follows from pi + 2p2 — qi — 2(72 > (See Section [5] for details.). Then one has that 

E"jXT,) = l-h. (3) 

On the other hand, as oj is degenerated, one follows from Theorem 11.11 and Theorem 11.21 that 

E°{T,) = 1 + ^ uiQ'+\2, 2, 1, 1, 1, 0, 2, 2, 1)^, 

where Q is the mean offspring matrix of a homogeneous multitype branching process (See (|48|) below.) 
and til is the mean of the immigration (See p7p below.). But by the Ward Equation, one has that 

£;0(XtJ = E^jTi)E^JXi) = (l + ^ uiQ'+\2, 2, 1, 1, 1, 0, 2, 2, 1)^) (p, + 2p2 - qi - 2q2). (4) 

We test (with the help of Matlab) that the right-most-hand sides of ^ and (j?]) are the same. 

At last, as application of the branching structure, we prove a law of large numbers for transient (2- 
2) random walk in ergodic random environment by a method known as "the environment viewed from 
particles" . 

We first define (2-2) random walk in random environment. Let f2 be the collection of cj = {uji}i^i 
and J' be the Borcl cr-algebra on il. Define the shift operator on 51 by 

Let P be a probability measure on (51,-^) making {fl, T,F,9) an ergodic system. The so-called random 
environment is a random element uj E chosen according to the probability P. 

The (2-2) random walk {Xn}n>o in random environment uj is define to be a Markov chain with initial 
value Xq = X and transition probabilities 

PU^n+l = l+j\Xn =i)= UJ,{j), j e {1, 2, -1, -2}. 

The measure induced by {Xn} on (Z^,C/), with Q the Borel cr-algebra, is called the quenched 
probability and the probability P^ defined on (Z^,C/) by the relation 



P"(S) = j Pl^{B)¥{dLo), Beg 



is called the annealed probability. 

We show the following law of large numbers. 

Theorem 1.3 Suppose that E'^lTi) <oo. Then one has that 

lim — — = Vp, 

n— foo Ji 

for some Vp. Moreover 

Ep(u{lj)(2ojo(-2) + LJo{-l) + c^o(l) + 2c^o(2)) 

Vp = ^ 

Ep{D{u)) 

where n(a;) and D{u)) are defined in ( [57| j and ^59(1 below. 
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Remark 1.3 (1) The role the branching structure plays is to give the invariant density Tl{io) explicitly 
in terms of the environment lo. 

(2) In Bremont f^, the author also proved a law of large numbers for (L-R) random walk in random 
environment, see Theorem 1.10 therein. But Bremont did not give the specific form of the velocity 
Vp. The branching structure enables us to give the invariant density n(ci;) explicitly, so that we can give 
the velocity Vp explicitly. 



2 Exit probability from [a + 1, 6 — 1] 

In this section we calculate the exit probabilities of the walk from certain interval (a, b). 

Fix a < b. Let d'^[a, b] = {b,b + 1} and d^[a, b] = {a, a — 1} be the positive and negative boundaries 
of [a, b] correspondingly. For G [a — 1, 6 + 1], <^ E 9^ [a, b] U d~[a, b], define 

Vkia, b, C) = P^{thc walk exits the interval [a + 1, 5 - 1] at C)- 

For simplicity, we write 7^^(0,6,0 as VkiO temporarily. Define 

Wfc(-2) Wfc(-2) Wfc(-2) 

1 

10 

and set = Mr ■ • -M^. 

Proposition 2.1 Suppose that uji{—2) > for all i G Z. One has that 



;=a+l l=a+l 



b-1 6-1 

6-l„T 



l=a+l l=a+l 
6-1 6-1 



Vb-2ib) 



l=a+l l=a+l 



6-1 6-1 

ein^;lef J2 ein^-i[ei-e2]^-ein^+l[ei-e2]^(l+ ^ einf-^e^ 

l=a+l l=a+l 

and 

6-1 6-1 



-^3 



l=a+l l=a+l 



Vb-2ib+l) 



6-1 6-1 
ein^Tlef einf-i[ei -e2]^-ein|^-l[ei -e2]^(l+ ^ einf-^ef 

l=a+l l=a+l 
6-1 6-1 

l=a+l l=a+l 
b^ b^ ^ 

-in:;;lef einf-i[ei -e2]^-ein!;+l[ei -e2]^(l+ Y eiH^^ef 

l=a+l l=a+l 



(5) 



(6) 
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Remark 2.1 1) If uJi{—2) = for all i, then the random walk degenerates to (1-2) random walk. The 
exit probabilities could be calculated analogously as in Bremont JIJ. 2) If uji{2) = for all i Eli, then the 
random walk degenerates to (2-1) random walk. For the walk transient to the right, the exit probability 
'P(J5(— oo, a, a) = 1 for all k < a ^ 1. 

Proof of Proposition I2.lt 

One follows from the Markov property that 

which leads to 



Wfe(-2) 



(7) 



Then equation (jS]) becomes 



Writing the equation ([7]) in the matrix form, one has that 

1 {V,^,-V,m = (n.-n-i)(C) |. (8) 

1 j \{Vk+2-vu+im j \ {-Pk+i-Vkm 

Define 

{Vk+i-Vkm 

Vk{0=MkVk+i{0- (9) 

We note that the equation Vfc(C) = MkVk+i makes sense for k £ {a,b]. Since Va-2{o.,b, C) has no sense, 
so is VaiO- Since Vb{a,b,b) = l,n(a,fo,6+ 1) = 0, and Vb+i[a,b,b) = 0, ^+1(0, fe, & + 1) = 1, then 

/ {Vb-i - Vb-2){b) \ ( {Vb-i - Vb-2m 
Vbib) = (Pb - Vb-iM = 1 - Vb-i{b) 

V J \ -1 

and 

/ {Vb-i - Vb-2){b + 1) \ / {Vb-i - Vb-2){b + 1) 

Vb{b + 1)=\ {Vb-Vb-i){b+l) = -Vb-iib+l) 

Substituting to ([9]) one has that 

eiVkib) = {Pk-i - Vk-2) (b) = eiMk ■ ■ ■ Mb-i {Vb-i{b)[ei - 63] - Vb-2{b)ei + [ea - 63])^ . 
Summing from fc to — 1, it follows that 

(Vb~2 - Vk-2) (b) = ^eiMi • ■ ■ Mb-i(Vb-i{b)[ei - 62] - ^-2(^)61 + [ea - 63]) . (10) 

l=k 
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Note that Pa{a,b,b) ^0. Then 



Vb-2{h)= eiMr ••A/h-i(n-i(fo)[ei -ea] -n-2(6)ei + [e2 -eg] 

l=a+2 



On the other hand, since 



= (Pa - Va-i){h) = eiMa+1 ■ • ■ Pfc-i (&) [ei - ea] - n-2(&)ei + [es - eg] 



then ^ 

' eiMa+i---A/6_i(n-i(&)[ei-e2]-n-2(fo)ei + [62-63]) =0, 

6-1 

Vb-2{h)= eiA/r--M6-i(n-i(6)[ei-e2]-n-2(fo)ei + [e2-e3: 

i=a+l 

Solving pT|) . one gets ([S]). 

Also, for a + l<A;<6 — 3, one has from (flUl) that 

6-1 

Pfc(&) -n-2(6)(l+ ^ einf-^e? 

l=k+2 

b-1 6-1 

5] einf-i[ei-e2]^- ^ eiH^-i [e2 - 63]^. 

l=k+2 l=k+2 

Next we calculate Vb-i{b + 1) and 'Pb-2{b + !)• Similarly as pT|) . one has that 

eiA/a+i---A/b_i(n-i(fo+l)[ei -62] - n-2(fo + l)ei +63)^ = 0, 
6-1 

n-2(& + l)= 5Z eiAfr--M6^i(n-i(&+l)[ei -e2] -n-2(fo+ 1)61+63 
;=a+i 

which leads to 

Also for a + 1 < fc < 6 — 3, one has that 



(11) 



6-1 

7^^(6 + 1) =n-2(fo+l)(l+ ^ einf-ie?" 

;=A:+2 

6-1 6-1 

-n-i(6 + i) J2 6in['-i[ei-e2]^- ^ 6in|'-i.3 

i=fe+2 l=k+2 



3 Path decomposition— Proofs of Theorem 11.21 



□ 



Throughout this section, we always assume that limsup„_).j^ Xn = oo. That is, the walk {X„} is transient 
to oo or recurrent. The notation {i — j} will be always used to denote a jump (a step) by the walk from 
i to j. 
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Define 

Ti = inf{n > : X„ > 0}, 

the hitting time of [1, oo). The purpose of this section is to count exactly all steps by the walk before Ti. 

3.1 The excursions, corresponding probabilities and immigration distribu- 
tions 

From Proposition 12. II and Remark |2.1[ we see that the exit probabilities of the walk from certain interval 
(a, b) could be expressed in terms of w. So we always assume that all these exit probabilities are already 
known in the remainder of the paper. 

For k < i < j, denote 

fk{i,j) = P^(the walk hits (i, oo) from below at j). 

We remark that for (2-2) random walk, in the definition of /fc(j,j), the term j only takes values in 
{i + l,i + 2}. With the notations of Section[2l 

fk{i,i + I) Vk{-oo,i + l,i + 1) and /^(i, i + 2) = Pfc(-oo, i + 1, i + 2). 

Next we analyze the path of the walk. 

Firstly, we consider a special excursion, which will be called type-.4 excursion latter, of the walk. 

Definition 3.1 We call excursions of the form {Xk = i,Xk+i = i — l,Xk+2 ^ * — 1, ■••,^A;+; < * — 

l,Xk+i+i > i} type-A excursions at i. Corresponding to the three kinds of possible last step of type-A 
excursions i, say, {i — 1 — > i}, {i — 2 — > i} and {i — 1 — > i + 1}, we classify type-A excursions at i into 
three sub-types Ai.i, Ai^2 and Ai^3. 

An excursion will be also called a particle some times in the remainder of the paper. 

Note that a typc-^ particle at i begins when the walk jumps down from i to i — 1. After that the 
walk runs in (— cxo, i — 1]. At last the walk hits [i, oo) at some j and the excursion goes to end. 

Next we define some indexes aj,3 and a,. 2 correspondingly to Ai.i Ai^s, and Ai^2- Let 

l)]"[c^.-i(-2),A-3(» - 2,z - l)]'"c^,-i(l), 

l)]"[c^,_i(-2)/,_3(* - 2, z - l)]™c.,_i(2), 

n,7n>0 

Note that a^^i differs from ai^s only in the last term of the product. Therefore we explain only the 
meaning of The first term a;i(— 1) is transition probability of the first step of the excursion Ai_i 
from i to i — 1. The last term a;i_i(l) is transition probability of the last step of the excursion Ai^i from 
i — 1 to i. The summation in the center indicates all events occurring between the first step and the 
last step. In details, before the last step happens, n steps of the form {i — 1 — >■ i — 2} and m steps of 
the form {i — 1 — i — 3} occur and the total number of possible combinations of these m + n steps is 

The term uJi-i{—l)fi-2{i — 2, i — 1) means that, with probability ci;i_i(— 1), a step 



aj,i:=Wj(-l) y j — — [a;j_i(-l)/j_2(« - 2,1 ■ 



(-1) E 



(n + m)\ , , s „ , 
^— -^[c^,_i(-l)/,_2(*-2,z 

r?, ' rr?, ' 
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{i — 1 — > i — 2} occurs, and starting from i ~ 2, with probability /i-2(* ~ 2, i — 1), it hits [i — 1, oo) at 
i — 1. The term a;i_i(— 2)/i_3(i — 2, i — 1) could be explained analogously. 

In fact, ai^2 could be defined similarly as a^^i and a^^a. But the definition is tedious. We note that 
after the walk jumps down with probability 1) from i to i — 1, then starting from i — 1, it hits [i, oo) 
with probability 1. Then the summation of Q!,;.i, ai^2-, a-nd 0^.3 should be — 1). So we define 

Oii,2 ■= - ai^i - ai,3. 

Some easy calculation shows that 

a;.t(-l)tj,_i(l) 

~ 1 - ^^-l{-l).f^-2{^ - 2, ^ - 1) - w,_i(-2)/i_3(i - 2, ^ - 1) ' 

"'■^ " 1 - UJ,^l{-l)f^-2{^ - 2, f - 1) - L^,_i(-2)/,_3(i - 2,^ - 1)' 

- - uj,^i{2) - uJ,^l(-l)f^-2(^ -2,i-l)- cj,_i(-2)/,_3(i - 2, i - 1)] 

1 - c^.-i(-l)/z-2(« - 2, 1 - 1) - c^,_i(-2)/,_3(« - 2, ^ - 1) 

Secondly, we describe another excursion, that is, typc-i3 excursion. 

Definition 3.2 We call excursions of the form {X^ ~ i,Xk+i = i — 2,Xk+2 < * — 1, ■••,^fc+i < * — 
l,Xk+i+i > i} type-B excursions at i. Corresponding to the three kinds of possible last step of type-B 
excursions at i, say, {i — 1 — > i}, {i — 2 -> i} and {i — 1 — > i + 1}, we classify type-B excursions at i into 
three sub-types Bi^i, Bi 2 and Bi^^. 

Note that a type-i3 excursion begins when the walk jumps down from i to i — 2. After that the walk runs 
in (— cxD, i — 1]. At last the walk hits [i, 00) at some j and the excursion goes to end. 

Next we define some indexes Pi^i /3i.2 and Pi ^3 corresponding to Bi^i Bi^^, and Bi^2- Let 

2,z-l)]"Wi(l), 

(12) 

2,j-l)]"c^,_i(2), 

Pi^i differs from a^.i only in the term aji(2)/,;_2(* ~2,i ~ 1). We explain only this term. Starting from 
i, with probability 2), the walk jumps down from i to i — 2 and the excursion begins. Recall that /3i.i 
is the index corresponding to a Bi^i excursion. Since a Bi^i excursion ends with a jump {i — 1 — ;> i}, after 
visiting i — 2, it will reach i ~ 1 from below before it comes to end. The sum of products of transition 
probabilities of all possible paths from i — 2 to hit i — 1 from below is /i_2(« — 2, i — 1). 

One follows from that 

g ^ ^^(-2)/.-2(^-2,^-l)cJ,_l(l) 

1 - c^,-i(-l)/,-2(* - 2, ^ - 1) - w,_i(-2)/,;_3(« - 2, ^ - 1) ' 
g ^ ^^(-2)/.,-2(^-2,^-l)cJ,_l(2) 

1 - c^.-i(-l)/.-2(* - 2, ^ - 1) - c^,_i(-2)/,_3(i - 2, ^ - 1) ' 



A,i :=w,(-2)/,_2(«-2,z-l) 

X V + "^)! - 2,z - l)]"[c.,_i(-2)/,_3(» - 

n,m>0 

ft,3 :=w.(-2)/,_2(^- 2,1-1) 

X V t 7^' N-i(-l)/.-2(» - 2,^ - l)]"[c.,_i(-2)/,_3(» - 
■'^ — ^ n\m\ 

n,7n>0 

/3,,2 :=w,(-2) - A,i -/3,,3. 
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g ^ ^^{~2)[l ~ + c^,_i(2))/,_2(» ~2,i~l)~ aj,_i(-2)/,_3(i -2,i~ 1)] 

l-c^,_l(-l)/,_2(^-2,^-l)-CJ,_l(-2)/,_3(^-2,^-l) 

At last, wc define the third kind of excursion, type-C excursion. 

Definition 3.3 We call excursions of the form {Xk = « + l,Xk+i = i — l,Xk+2 < * ~ l,---j^fc+i < 
i — l,Xk+i+i > i} type-C excursions at i. Corresponding to the three kinds of possible last step of type-C 
excursions i, say, {i — 1 — i}, {i — 2 — i} and {i — 1 — i + 1}, we classify type-C excursions at i into 
three sub-types C^.i, Ci^2 andCi^^. 

Note that a type-C excursion at i begins when the walk jumps down from i + 1 to i — 1. After that the 
walk runs in (— cxd, i — 1]. At last the walk hits [i, oo) at some j and the excursion goes to end. 

Next we define some indexes 7^,1 ji^2 and 7^,3 corresponding to Ci,i Ci.3, and Ci,2. Let 
7m :=^m(-2) V ^" t T^' - - l)]" [^,,_i(-2)/,_3(» ~ 2, z - 

?i,m>0 

(n + m)! ^_ ^ ./ „/',■_ o iM"r,,,. /_o\f. o _ 1 M™,,,. . ('o^ (-'-^) 



7^,3 := w,+i(-2) V ^ T - 2,* - l)]"[u;,_i(-2)/,_3(* - 2, z - l)]™w,_i(2), 

n,m>0 



A C.i excursion differs from an Ai.i excursion only in the first step. The first term in the product of 
7j;_i is 2). It means that with probability 2), the walk jumps down from i + 1 to i — 1, and 

the excursion begins. 7i_2 and 7^,3 could be understood analogously as ai^2 and Ui^^. We will not repeat 
them here. 

One follows from that 

^^i+i(-2)wj-i(l) 



7i,i = 
7^3 = 

7t,2 = 



1 - c^,_i(-l)/,_2(j - 2, i - 1) - cj,_i(-2)/,_3(« -2,1-1)' 

cJi+i(-2)a;,_i(2) 

1 - ^,-i{-l)f,-2{i -2,i~l)- w,_i(-2)/,_3(« - 2, i - 1) ' 

cj,+i(-2)[l - - cj,_i(2) - cj,_i(-l)/,_2(« -2,1-1)- w,_i(-2)/,_3(i - 2,^ - 1)] 



1 - cj,_i(-l)/,_2(j - 2, 1 - 1) - cj,_i(-2)/,_3(« - 2, i - 1) 
Define 

Aij = ^{Ai.j excursions before Ti}, 
Bij = #{Bij excursions before Ti}, 
Ci_j = if{Ci,j excursions before Ti}, 

for i < and j = 1, 2, 3. 

We aim at counting exactly all steps by the walk before Ti. For this purpose, define 

Ui = {Ai^i, Ai 2, Ai^3, Bi i, Bi 2, Bi 3, Ci^i, Ci^2,Ci^3) 

being the total number of different excursions at i before time Ti. Next we show by path decomposition 
that {Ui}i<Q is a non- homogeneous multitype branching process. 
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The imaginary step 



^1,1 Aio A 



1,3 



2 
1 




Figure 2. The figure illustrates the immigration of the braching 
process. Adding the imaginary step {1 — > 0}, the path of the walk 
before Ti forms an A excursion at 1. It may be an i, A1.2 
or Ai. 3 excursion 



Firstly, the branching process needs an ancestor (some particle immigrating in). The walk starts 
from 0. But before Ti, there is no jump down from above 1 to by the walk. One can imagine that 
there is a step by the walk from 1 to before it starts from (One can also imagine that this step is 
from 2 to 0. But this makes no difference.), that is, set X_i = 1. Adding this imaginary step, the path 
{X^i = 1, Xq = 0,Xi, Xti } forms a typc-^ excursion at 1 such that 

+^1,2 +^1,3 = 1- 

The distributions of Ai_i, Ai_2, and A1.3 are 

ais '^o(l) 



P'iAis = 1) = 
P'(.A,^3 = 1) = 



ai.i +ai,2 + ai,3 1 - c^o(-l)/-i(-l, 0) - c.'o(-2)/-2(-l, 0) ^ 

"1,3 ^^0(2) 



and 



+ ai,2 + ai,3 1 - c^o(-l)/-i(-l, 0) - cjo(-2)/-2(-l, 0) ' 

P°{Ai,2 = 1) = 



ai,2 



ai.i + ai,2 + ai,3 
^ [1 - cjo(l) - uo{2) - c^o(-l)/_i(-l, 0) - c^o(-2)/_2(-l, 0)] 
1 -c^o(-l)/-i(-l,0) -c^o(-2)/-2(-l,0) 

The meaning of P°(^i,i = 1) is obvious. The total sum of the product of transition probabilities of all 
excursions of the form {X^i = 0,Xq = l,Xi, ...,Xti} is ai_i + ai^2 + 01^3 = wi(— 1) and the total sum 
of the product of transition probabilities of all possible paths of an Ai^i excursion is ai^i. Therefore 
pO(Ai,i = 1) = The values of P^(Ai,2 = 1) and P°(Ai,3 = 1) could be explained 

analogously. 

We can treat the above discussed imaginary excursion as the particle immigrates in the branching 
system, say, the ancestor (immigration) of the branching process. The immigration laws are 

^"'"■^'"■'■"-°»^ i-..,(-i)/-.(-rf .„(-2)/-.(-i.o) - <'^' 
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and 

PJU, - (0,0,1,0,...,0)) i_.„(_i)/_,(_i,o)-.„(-2)/_,(-l,0) • ^''^ 

3.2 Branching mechanisms 

After revealing the immigration, we discuss the branching mechanism. Ahhough there are 9 types of 
particles in the system, many of them share the same offspring distributions. 

(a) Offspring distributions of Ai+i.i, -4i+i.3, Ci+i,i and Ci+1.3 particles 

For i < 0, conditioned on Ui+i ~ (1,0, ...,0), that is, {Ai+i^i = l,Ai+i^2 = = = 

= = Ci+1.1 = (^1+1.2 = (^1+1.3 = 0}, we study the distribution of Ui. Note that the first 

step of excursion Ai+i.i is {i + 1 — > i} and the last step is {i — > i + 1}. All contributions of this excursion 
to Ui occurs between these two steps. Therefore this particle could give birthes only to excursions Ai^i-, 
Ai^2, Bi^i, and Bi^2- We calculate the probability of the event 

{Ais = a. A;, 2 = fo, = c, Bj,2 = d}, 

that is, 

{U, = (a,6,0,c,d,0,0,0,0)}, 

conditioned on {A^+i 1 ~ l}(Or = (1, 0, 0)). Indeed, one follows from the strong Markov property 
that these a + 6 + c + d excursions at i are independent, and the total number of all possible combinations 
of those excursions is ■^^^-^^jTfgr^ • Therefore 



P°(C/, = (a, 6,0, c, d, 0, 0, 0, 0) = (1, 0, 0)) 



(a + fe + c + d)! ^ f, ^ ^ 



(17) 




A, 1 -4i,2 5i, 2 

Figure 3. The figure illustrates the ofi'springs of Ai+i_i, A+i^s, Ci+1.1 
and Cj-i-1^3 partcles. They could only give births to A, ii -4^.2, ^i. 1 and 
Si^ 2 particles. 

One notes that Ai+i,3, Ci+1,1, Ci+i_3 and excursions share a common property, that is, the first 

step is from above i to i and the last step is from i to above i. Therefore they share the same offspring 
distribution. So analogously, one has that 

P°(C/, = (a, 6,0, c,d, 0,0, 0,0) I [/,;+! = (0, 0, 1, 0, 0)) 

= a!6!drf! <i"12/^mA^2(1 - " "^,2 - - ^,2), 
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P0(C/, = (a, 6,0, c, d, 0, 0, 0, 0) ^ (0, .., 0, 1, 0, 0)) 

{a + b + C + dy. a b r^c nd n 

= d6!c!d! "i,i"*,2ft,iPi,2(l - - ai,2 - Pi.i - Pi,2), 

P°iU, = (a, 6,0, c, d, 0, 0, 0, 0) |;7,;+i = (0, .., 0, 1)) 

ja + b+C+dy. a b r^c nd n o ^ 

= alblcldl "^i"*,2ft,iPj,2(l - " ai,2 - P^,l - Pi,2)- 

(b) OfTspring distributions of ^+1,2, and Ci+i 2 particles 
Ci+i, 2 A+i, 2 

i + 2 . 

i + 1 




(19) 
(20) 



P0(A:,3 + B,,3 = 1) = 1 



Figure 4. The figure illustrates the offsprings of Ai+1.2, Ci+i.2- Before 
the last step {i — 1 — >■ i + 1} happens, with probability 1, a Bi^s or A, 3 
excursion would be born. 

Conditioned on {Ut+i = (0, 1, 0, 0)}, that is, {Ai+1^2 = l,Aj+i,i = Aj+i,3 = = Bt+1,2 = 

-Bi+1,3 = = Ci+1.2 = Ci+1.3 = 0}, we discussion the distribution of Ui. Recall that the first step of 

an excursion is {i + 1 — !> i} and the last step is {i — 1 — ?■ i + 1}. Things get delicate because the 

last step {i — 1 — >■ i + 1}. Before the last step occurs, the walk must jump down from i, possibly to i — 1 
or i — 2. If it jumps down from i to i — 1, it gives birth to an Ai.3 particle; if it jumps down from i to 
i — 2, it gives birth to a Bi,3 particle. That is 

pO(A,3 + S,^3 = l|C/,+i=e2) = l. 

The sum of the product of the transition probabilities of all possible paths of an excursion Ai^s is 01^.3, 
and that of a Si. 3 excursion is f3i,3. In this point of view, one concludes that 



P°(A,3 = l\U,+i = 62) = 1 - P°(S,,3 = l\U,+i = 62) 



at,3 + A 



i,3 



(21) 



Before giving birth to the above discussed particle Bi^^ or ■42:^3, the excursion Ai+1,2 may give birthes 
to a number of Ai^i, Ai^2, Bi^i and Bi^2 particles. Once again, one follows by path decomposition and 
Markov property that, all excursions born to particle Ai+1^2 are independent. Therefore one has that 



and 



P°(C/, = (a, 6,1, c, d, 0, 0, 0, 0)\U,+, = (0, 1, 0, 0)) 

_ {a + b + c + dy , , 

alblcldl "^l"^2P^,lP^,2U a^ 



P^{U, = (a, 6,0, c, d, 1, 0, 0, 0)|[/,+i = (0, 1, 0, 0)) 



1 — OLi,2 — A,l ~ Pi.2)' 



^1,3 



(22) 



{a + b + C + dy. ^ 



alblcldl 



i,3 



(23) 



ai,3 + Pi..?. 
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Also, analogously, the offspring distributions of a Ci-i-1.2 particle are 
P0(C/, = (a, 6,1, c, d, 0, 0, 0, 0) |C/,+i = (0, 0, 1, 0)) 



and 



{a + b + c + dy. ^ , 



a!6!c!d! 



"1,3 



P°([/, = (a, &,0, c, d, 1, 0, 0, 0)|C/,+i = (0, 0, 1, 0)) 



a\b\dd\ 

(C) Offspring distributions of Bi+i,i, and particles 



ai,3 + Pi. 



1,3 



ai,3 + ft, 3 



(24) 



(25) 



i - 2 




P°(Ci,l+C,,2 = l) = l ^ 



i, 2 



i, 2 



Figure 5. The figure illustrates the ofTsprings of S^+i^i and ^^+1^3. Since 
at last, the walk jumps from i to some position above i, before the 
last step happens, it must return to i from below. Therefore with 
probability 1, a Ci^i or a Ci^2 excursion would be born. 

and Bi^i^s excursions differ from each other only in the last step. But their last steps are 
both from i to above i. Therefore they have the same offspring distributions. Conditioned on Ui+i = 
(0, 0, 0, 1, 0, 0), that is, = 1, = ^i+1,2 = ^i+1,3 = -Bi+1,2 = Bi+1,3 = = Ci+1.2 = 

Ci+1,3 = 0}, we discuss the offspring distributions of Bi+i,i particle. Note that an excursion Sj+i.i begins 
with a jump {i+1 — — 1} and ends with a jump {i i + 1}. So after jumping down from i + 1 to 
i — 1, it must have an excursion returning to i. There arc two approaches for the walk to return to i, that 
is, jumping from i — 1 to i or jumping from i — 2 to i. From this point of view, one knows that a 
particle gives birth to a Ci^i or Ci^2 particle at i with probability 1, and the approach the walk jumping 
from below z to i determines which particle will be born. Precisely, one has that 



It/, 



64) 



1. 



Due to the same reason as (Hi 



7i,i 



p°(Q,i = i|c/,+i = 64) = 1 - p^(a,2 = i|c/^+i = 64) = 

After giving birth to a C^^i or Ci.2 particle, a Hi+i.i particle may give births to certain number of Ai^i, 
•^i.2i and Bi 2 excursions. Markov property implies the independence of those born excursions. One 
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has that 



P^{U, = {a, 6,0, c, d, 0, 1, 0, 0)\U,+i = (0, 0, 0, 1, 0, 0)) 



{a + b + c + d)\ ^ 



alblddl 



a°,i<2/3u/3- 2(1 " - a..2 - ft.i - A.2) 



and 



P^{U, = (a, 6,0, c, d, 0, 0, 1, 0) |;7,+i ^ (0, 0, 0, 1, 0, 0)) 

(a + b + c + dy. ^ ^ ^ ^ 7i,2 

= iTTTTi "j,i"«,2ft,ift,2(l - - ai.2 - Pi,i - Pi, 2) • 

a'McJ.d'. 7j,i+7i,2 

Analogously, the offspring distributions of a ;Bi+i_3 particle are 
P^{U, = (a, 6,0, c, d, 0, 1, 0, 0) = (0, 0, 1, 0, 0, 0)) 



{a + b + c + d)\ „ 



a!6!c!d! 



a°,l<2/3u/3- 2(1 - - a^,2 - - A,2)- 



7i,i 



7i,l + 7i.2 



and 



P^{U, = (a,6,0,c,d,0,0,l,0)|;7,+i = (0, 0, 1, 0, 0, 0)) 

{a + b + c + dy. a ^ . , 

= ^ — ^Mm\ — ^"m<2/3mA- 2(1 - - a»,2 - A,i - A,2): 

(d) Offspring distribution of -Bi+i,2 particles 



7i,2 



7i,i + 7i,2 



-■1+1,2 



i + 1 

i 

i - 1 
i - 2 



Figure 6a. The figure illustrates the ofTsprings (case 1) of Si+i_2 
excursion. The walk never visited i between the first and the last 
step. Theofore, only a type Cj.3 excursion would be born. 



i + 1 




P°(C,,l+Cz,2 = l) = l A,l A, 2 -B,,! S,,2 P0(A,3+S.,3 = 1) = 1 

Figure 6b. The figure illustrates the offsprings (case 2) of Bi+1, 2 
excursion. Between the first and the last step, the walk did visit i. 
Therefore P°{Q, 1 + C,, 2 = 1) = 1 and pO(A, 3 + 3 = 1) = 1- 
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Next conditioned on Ui+i = (0,0,0,0,1,0,0,0,0), that is, {i?i+i,2 = l,Ai+i^i = = = 

~ = Cj+i.i = Ci+i_2 = C'j+i.s = 0}i we consider the offspring distributions of Bi^i^2 

particles. 

Special attention should be payed to iJi+i ^ excursions. An excursion f?i+i,2 begins with a jump 
{i + 1— — 1} and ends with a jump {i — 1— >i + l}. The point is whether it visited i between the 
first and the last step. If it did not visit i before the last step, then the excursion gives birth to a C^^a 
particle with probability 1 and generates no any other particle. If it did visit i before the last step, that is, 
conditioned on {C^^s = 0}, things get much more complicated. Conditioned on {C^^s = 0}, after jumping 
down from i + I to z — 1, the walk reaches i from below i at least one time, that is, from z — 1 to i or 
from i — 2 to z. Therefore one has that 

P°{a,i+Q,2 = l\U,+i = e5,Q,3 = 0) = 1, 

and similarly as (PT|) that 



P°(C,,i = l\U,+i = es, a,3 = 0) = 1 - P!i{a,2 = l\U,+i = 6,5, C,,3 = O) = 



7i,i 



+ li,2 



Since the last step of excursion Bi+1.2 is from i — 1 to i + 1, conditioned on {C/i+i = 65, C;, 3 = 0}, 
after reaching i from below, it must jump down from i to i — 1 or from i to t — 2 at least one time, before 
the last step {i — 1^-i + l} occurs. In the other words, 

P0(A,,3 + B,,3 = l\U,+i = es, a,3 = 0) = 1 

and 

P°(A,,3 - l\U,+i = e5,C,,3 = 0) = 1 - P°(B,,2 = l\U,+i = 65,^,3 = 0) - 



"1,3 + Pi,3 

On the other hand, conditioned on {Ui+i = 65,6*^^3 = 0}, besides giving birthes to the above discussed 
particles, it may give birthes to a number of Ai.i, Ai.2, Bi,i and Bi,2 particles. 

Next we calculate the probabilities of {Ci.3 = 1} and {Ci.3 ~ 0} conditioned on {Ui+i = 65}. 

One follows from the above discussions that the sum of the products of transition probabilities of 
all possible paths of an excursion Bi-^.l^2 is A+1,2 and all those possible paths could be divided into two 
classes. Paths of the first class never visited i and paths of the second class visited i from below certain 
times. Sum of the product of transition probabilities of all possible first kind paths is 74^3 and that of the 
second kind paths is /3i+i.2 — 7i.3- Therefore, 



P°(C,,3 = l|C/.+i = es) = 1 - P°(a;, 3 = 0|C/,+i = 85) 



7i,3 
3i+l,2 



Also the Markov property implies the independence of all excursions born to Bi+1^2 particle at i. One 
follows by path decomposition and independence that 

P;^{U, = (0, 0, 1) |C/,+i = (0, 0, 0, 0, 1, 0, 0, 0, 0)) = (30) 



Ji+1,2 

P°(C/, = (a,fe,l,c,d,0,l,0,0)|f/,;+i = (0,0,0,0,1,0,0,0,0)) 

P°(C/, = (a,6,l,c,d,0,0,l,0)|[/,;+i = (0,0,0,0,1,0,0,0,0)) 

(a + b + c + d)! h «c fld /I ^ ^ o ^ (/3»+i,2 - 7i,3)7i.2a»,3 (32) 

a'olcld! , , , , Pi+i,2(7i.i +7i,2)(ai.3 +Pi.3) 
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P^([/, ^ (a, &, 0, c, d, 1, 1, 0, 0) |(7,+i - (0, 0, 0, 0, 1, 0, 0, 0, 0)) 

(a + fe + C + d)! , i ac ad 



a\h\c\d\ 



"uai,2A\i/^i.2(l ~ - "»,2 - A,i - ft, 2) 



(A+1,2 - 7»,3)7»,ift,3 (33) 

ft+l, 2(7^,1 + 7i,2)(Q!i,3 + ft.s) ' 



and 



P°(C/, = (a, \ 0, c, d, 1, 0, 1, 0)|;7,+i = (0, 0, 0, 0, 1, 0, 0, 0, 0)) 

(a + fe + c + d)! , . (ft+i,2-7.,3)7.,2ft,3 (34) 

" -ai,iai,2Pi,lft,2(l - "j,! - "»,2 - Pi,l - Pi.2)- 



a\h\c\d\ 



ft+i, 2(7^,1 + 7i,2)(a^3 + A\3) ' 



Summing up the discussions of this section, we have the fohowing theorem, which has also been stated 
as Theorem 11.21 in the introduction section. 

Theorem 3.1 {Ui\i<\ is a 9-type non-homogeneous branching process with immigration distribution as 
in (T^, 03) and [J^ above, and offsprings distributions as in ^]§M§, ^EMW, ^EMW and 
above. 



Corollary 3.1 Let Qi be a 9 x 9 matrix, whose l-th row are the means of number of particles born to a 
type-l particle of the i + l-th generation. The matrices Qi are called the mean matrices of the branching 
process {C/i},<i. Let = i-a- i-c^T-P- i-l3- 2 ' = ~ ~' ^' 



l-Qi,i-ai,2-/3i,i-ft,2 ' ft + 1.2' * 



1 — C<i,l— Qi,2— /9i,2 ' 

— — and ti = — — _ 

Cti,3+Pi,3 7i,l+7i.2 



1 — ai,2— /3i,i— ft,2 ' 

Then one calculates from 



the branching mechanism of {Ui}i<i that 
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(35) 



4 The ladder time Ti and the branching process— Proof of The- 
orem 11.11 



Recall that Ti = mi{n > : X„ > 0} is the first hitting time of [l,oo). In this section, we aim at 
expressing Ti in terms of the multitypc branching process {t/i}i<i. 

Define 

Di i = =i^{ steps by the walk from above i — 1 to i — 1 before time Ti}, 
Vi_i = #{steps by the walk from i — 1 to i before time Ti}, 
Vi^2 = #{steps by the walk from i — 2 to i before time Ti}. 
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Then ^i<:Q Di,i counts all steps jumping downward by the walk before time Ti and X]i<o^''i ^'.2 
counts all steps jumping upward by the walk before time Ti. But both X]i<o ^'.1 Si<o ^'.1 ^~ ^'.2 
did not count the last step by the walk hitting [1, 00). Therefore 

i<0 

This together with the fact D^ i = Ai^i + Ai^2 + A,3 + Q^i + (7^,2 + Ci^s, V^^i = A^^i + Bi i + Cj_i and 
Vi,2 = Ai,2 + Bi^2 + Ci,2 implies that 



Ti = 1 + ^ 2A,,i + 2A,^2 + + + B,^2 + 2C,,i + 2Q,2 + C, 

i<0 

= 1 + ^C/,(2, 2, 1,1, 1,0,2,2,1)^ 



i<0 



(36) 



which proves Theorem ll.il 

Next we calculate the moment of Ti by mean of the branching process. 
One calculates from the immigration distributions (|14m6p that 

E^iU,)^( , , ,0,...,0) =:.r. (37) 

\q;i,i + q;i,2 + ai,3 + "1,2 + ai,3 ai,i + ai,2 + 011,3 / 

Therefore one follows from Markov property that, for i < 0, 

£;S((7,) ^uigo'-'Q^- 
Substituting to one has that 

EliTi) = 1 + ^ "iQo ■ ■ • Q^% 2, 1, 1, 1, 0, 2, 2, 1)^. (38) 

i<0 



Remark 4.1 About the branching structure, we have the following remarks: 

- The authors found that the branching structure could be simplified. Indeed, note that Cij has the 
same offspring distribution with Ai,j^ j = 1,2,3, and that Aij and Cij, j = 1,2,3, play the same 
role in the ([36]). One could treat Aij and Ci_j, j = 1, 2, 3, as the same type particles. In this point 
of view, a 6-type branching process is enough to count exactly all steps by the walk before Ti. 
However we still use the original 9-type branching process because it is more understandable and 
each of the 9-type particles correspond to specific jump of the walk. 

- While R = 1 the branching structure coincides with the one for (2-1) random walk constructed 
in Hong- Wang [3]. Indeed, for (2-1) model, there are only three type excursion, that is Ai^i, Bi^i 
and Ci_i. But as the above discussed, one could treat Ai_i and Ci^i particles as the same type. So 
one need only to consider a 2-type branching process Ui ~ {Ai^i, Bi^i). For (2-1) random walk, one 
follows easily that 

ai,i = '^j(-l) and /J^^ = lj,{-2). 
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Therefore, the distribution of Ai+i.i in P7)) degenerates to 

= {a,b)\U,+^ = (1,0)) - i^±^(,.,(-l))"(^,(-2))^c.,(l). (39) 

Since there is no jump of size 2 above, one see from Figure 5 that with probabiHty 1, a type Ci^i 
particle will be born to a particle. But we treat type Ci^i particle as type Ai^i particle now. 

Therefore the offspring distribution of Bi,i in ()26p degenerates to 

P^iU, = (a + l,fe)|[/,+i = (0, 1)) = i^±^(c.,(-l))«(c.,(-2))''c.,(l). (40) 
' a!o! 

The offspring distributions in ([M)) and (^01 coincides those offspring distributions in Hong- Wang 

m- 

- For (1-2) random walk, our result coincides with Hong-Zhang [3]. In this case, one needs only 
a 3-type branching process, that is Ui — (A^^i, Ai^2, ^i.s)- The offspring distributions of particle 
and AiJ^x.z in (flT)) and ((T8)) degenerate to 

F°([/, = (a,6,0)|t/,+i = (1,0,0)) = M^<,a,^2(l " "^,1 " "..2), (41) 
' a!o! 

F°([/, = (a,&,0)|;7,+i = (0,0, 1)) = ^^^<.i<2(l - - a.,2). (42) 
' a!o! 

For (1-2) random walk, one see from Figure 4 that, except generating offsprings as .4^+1, 1 particle, 

a type Ai.2 particle gives birth with probability 1 to a type Ai^z particle. Therefore the offspring 

distribution in ([^^ degenerates to 

P°([/, = (a,&, l)|t/.+i - (0,1,0)) = l^-t^<,a,^2(l - «M - «.,2). (43) 
One see that the above (01]), (|42p and P5)) coincide with those offspring distributions in Hong-Zhang 

S- □ 



5 An example for testing the branching structure 

In this section, we let — {q2,qi,pi-,P2) where Pi , P2 , 91 , 92 > and <Z2 + 91 + Pi + J52 = 1 and let lu = 
(..., Wo, Wo, Wo, ...). Now consider the random walk {^n} in the environment w. Note that the transition 
probabilities of {^n} are now independent of the position. 

We always assume that 

Pi + 2p2 - gi - 2^2 > (44) 

which implies that lim sup„_j.o2 X„ = 00. We also mention that for such degenerated w, Xn could be 
realized by i.i.d. sum. Precisely, let Sn ^^7=1^^^ where {£,n} is an independent sequence of random 
variables with common distribution P{^i = I) — pi, P(^i = 2) = p2, ^(^1 = —1) = Qi and P{^i = —2) = 
q2. Then {Xn} = {Sn}. 
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qi+q2 


P1+P2 


P2 


92 


92 


92 


1 











1 






Let 

M = 

One follows from that M has three simple eigenvalues. Let /, g and /i be the eigenvalues of M such 
that I/I > I5I > \h\. Then one follows also from ^ that |/| > I5I > 1 and -l<h<0. 

Indeed, define F(X) |A - A/£;| = + 9i±92^2 _ £i±p2;^ _ £2^ ^pj^^^^ ^ _£2 q ^^^^^ 

F{-1) = ^'g^^'P^ > 0. Therefore F{x) has a root h e (-1, 0). Note also that F{y) > for y large enough 
and F{1) = ii+-2Q2~b^i+2p2) < rpj^^^ ^^.^sj j^^g ^ ^^^^ jj^^ ^-j^ ^jg^ F{-y) < for all y large enough. 
Since 1) > 0, F{X) has a root in (—00, —1). 

Note that the the exit probabilities in (O degenerate to 

fc-l 6-1 

eiM'— i[e2-e3]^(i+ ^ eiil/''-'/ef ) - eiM^-'^-ief ^ eiil/''-'[e2 - 63]^ 



Pb-i{b) 



l=a+l l=a+l 



Vb-2{b) = 



6-1 6-1 
eiM"— lef ^ eiM^"'[ei -ea]"^ -eiM''"''"^[ei - e2]^(^l + ^ eiM^'^'ef 

i=a+l i=a+l 
6-1 6-1 

eiM'— Me2-e3]^ ^ GiM^-' [Gi - 63]^ - GiM''-"-! [Gi - 63]^ ^ GjM^-' [g2 - G3] 

i=a+l i=a+l 



eiA/^— lef J2 eiA/''-'[Gi -G2]^-Ga/''-'^-l[Gi -G2]^(l+ ^ GiM^^'ef) 
/=a+l l=a+l 

(45) 

Letting a ^ — oo, by some careful calculations, one follows from (|^5]) that 

lim n-i(6) = l + 
/fc_2(l) := lim n-2(fo) = l + + 



(46) 



We remark that, for 5 = 1, and g 7^ 1, it is a bit different to find the limit of (|45| as a — ?> — 00. But the 
limits have the same form for both g ~ I and g I. 

Recall that Vb-i{h) is the simplification of Vb^i{a, b, h) which by definition equals to 
P(J^^(the walk exits the interval [a + 1, 5 — 1] at 5). 
Therefore one sees from (l46l) that 



/b_i(l) = ^(the walk exits the interval {—00, 6—1] at &) = 1 + ft,; 
/6-2(l) = P^~^(thc walk exits the interval (-00, h - I] aX b) = \ + h + . 

Similarly as all Mk degenerate to M, one follows by some careful calculations from ([6|) that 

/h_i(2) = Pj^^^(the walk exits the interval (—00, 6—1] at 5 + 1) = —h; 
/6-2(2) = P^~^(the walk exits the interval (-00, 5 - 1] at 5 + 1) = -/i - . 

Recall that Ti := mi{n > : X„ > 0}. Then 

/o(1) = P°(Xt, =l) = l + /i 
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and 

/o(2) = = 2) = -h. 

Therefore one has that 

E'JXT,)^l.fo{l) + 2foi2) = l-h. (47) 
Since h G (—1,0), 1 < E^^^{Xti) < 2, which is also natural by intuition. 

One should note that the above calculations of the mean of Xt^ involve only the exit probabilities of 
the walk from (— cxd,0]. 

On the other hand, recall that Ti could be expressed by the 9-type branching process constructed in 
Section [21 That is, 

Ti = l + ^ [7,(2,2,1,1,1, 0,2, 2,1)^. 

Since Ui ~ loq for all i, we omit the subscript "i" in the notation related. For example we write 
tti i as «!, Wi as w et al. One has the following results: ai = —qiPih/p2, a2 = qiip2 + hpi + hp2)/p2, 
"3 = -qih; Pi = -q2Pih{l + h)/p2, (32 = q2{P2 + {Pi+P2)H^ + h))/p2, k = -q2h{l + h); 71 -q2Pih/p2, 
12 = q2iP2 + hpi + hp2)/p2, 73 = -q2h; x = qipiK^/pl, y = -qih{p2 + hpi + hp2)/pl, z = q2Pib?-{\ + h) lp\, 
w = -q2h^il + q2h)/pl; v = 1 + P2/(/i(l + q2h)), s = qi/{qi + (?2(1 + h)), t = -pih/(j>2{l + h))- 
ui = {—pih/p2, (jp2 + Pih + p2h)/p2, —hp2/p2, 0, 0, 0, 0, 0, 0). With the above notations, the mean matrix 
Qi of the branching process {Ui} in ((35|) degenerates to 
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(48) 



Then one has from ([38|) that 

KiTi) = 1 + ^ uiQ'+\2, 2, 1, 1, 1, 0, 2, 2, 1)^. 

Note that if one assumes 

E^iXi) = pi + 2p2 - gi - 2q2 > 0, 

then Ward Equation 

E^JXtJ ^ E'jTi)E'jXi) (49) 

should hold. 

Recall that E^{Xti) was calculate in (|T7l) by the exit probability and that E^{Ti) was calculated by 
the branching structure constructed in Section [3] Therefore it will provide a good testification of the 
branching structure to show that Ward Equation (|49| holds. Equivalently, to show (j49]), one needs only 
to show 

l + ^^iQ'+^(2,2,l,l,l,0,2,2,l)^= ^/'^ (50) 

^ pi+ 2p2 -qi- 2q2 



22 



Some elementary calculation shows that Q has four nonzero eigenvalues Ai, A2, A3, A4, and all other 
eigenvalues are 0. One could find the eigenvectors to get a matrix B such that 

Q = BAB-^ (5f) 

with 



V / 



Theoretically, one could substitute ([5T|) to the left-hand side of ([SH]) to show that (|50p does hold. But 
the calculations are technical and tedious. Instead of giving such tedious calculations, some numerical 
test may be preferred. By the "Matlab" we get the following table. 



Test of the branching structure 


Pi 










:= El{T,)E't{X,) 


:=/o(l) + 2/0(2) 


Error 


0.2100 


0.3500 


0.3600 


0.0800 


0.3900 


1.467727692 


1.467727692 


-6.6613e-016 


0.3000 


0.2100 


0.3000 


0.1900 


0.0400 


1.323718710 


1.323718710 


2.8644e-014 


0.1789 


0.3211 


0.1801 


0.3199 


0.0012 


1.481684406 


1.481684406 


1.8585e-013 


0.4998 


0.0002 


0.4999 


0.0001 


0.0001 


1.000399840 


1.000399840 


-3.5456e-011 


0.3627 


0.1373 


0.3628 


0.1372 


0.0001 


1.226498171 


1.226490265 


7.9058e-006 



The column "i;°(XTi) = El{Ti)El[Xi) " of the table means that 

E^Xt,) = El{T^)El{X^) = £;°(Ti)(pi + 2p2 - qi ~ 2^2), 
where E^{Ti) is calculated by the multitype branching process {Ui}, that is. 



E"^{Ti) -1 + 51 "iO''''(2, 2, 1, 1, 1, 0, 2, 2, If. 

i<0 

6 Invariant measure equation and law of large numbers of (2-2) 
RWRE-Proof of Theorem D 

In this section, we consider random walk {Xf,} in random environment lu. Since by assumption E^(Ti) < 
cxD, then P°-a.s., Ti < cxd. 

Define ZJ{n) ~ Q-^^lo. The process {w(n)} is called the environment viewed from particles. One easily 
show that {w(ri)} is indeed a Markov process under either P° or P°, with transitional kernel 

K{uj,duj') = u„{2)6g2^^^, + cJo(l)<5ei.j=cj' + wo(-l)'5e-ia;=t^' + wo(-2)J(,-2„=„,. 

It is important to find the invariant measure and the corresponding invariant density for the transition 
kernel K{uj,duj'). If one has the invariant density in the hand, then one could show the law of large 
numbers for random walk in random environment {^n} and the limit velocity of the transient walk could 
be expressed by the invariant density. 
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We borrow some notations from [3] to give the invariant measure. Define (ysL — Pnk {^Ti = 1) and 



^e^cu = ^ei-J^T, = 2). Whenever E'^{Ti) < oo, define 



Q{du:) = + E l"(06<i^ and Q(dL.) = Q{du:) / Q{^1). 

Then one follows verbatim as [1] that the measure Q is invariant under transition kernel K{ijj,dijj'). 
Precisely, one has that, for B € T, 



Q{B)= // l^,eBK{uJ.du:')Q{duj). 



Also, following [J] one shows that 

dQ 



dP 



= E ^^r..(^.i^T, = 1) + i?r.^(iv,|XT, = 2), (52) 



i<0 



where N, #{fc e [CTi) : i}. 

dP- 



The branehing strueture enables us to calculate the right-hand side of (|52|) and give specifically 



In fact, note that for i < — 2, 

Ni + + + Ci+l,! + Ci+1,2 + C'i+1,3 

Then 

£;S(C/,+i(l,l,l,0,0,0,l,l,ir;XT, =1) 



i?i:(iv,|XT, = 1) 



P^{Xt, = 1) 
i;°([/,;(l,l,0,l,l,0,l,l,Or ;XT, = 1) 

^'"(^T, = 1) 



T. .X (53) 



Temporally, we set vi = (1,1,1,0,0,0,1,1,1)^ and V2 = (1,1,0,1,1,0,1,1,0)^. The first term in the 
right-hand side of (|53p equals to 

^ £;°((7,+iVi; Ai,i = 1) + _l-S0([/,+ivi;Ai,2 = 1) 



/o(l) " • ' /o(l) 

wi(-l) / 



(£;°([/,+ivi|Ai,i = l)P°(Ai,i = 1) + i?S(C/.+iVi|Ai,2 = l)P°(Ai,2 = 1) 

eiQo • • • tt/j+lVl H ; ; 62(^0 •••(yi+lVl 



"1,1 + ai,2 ^cki^i -I- a\,2 + ai,3 ttia + ai,2 + OLi.'i 

= ( ' ,0, ...,0)Qo ■ • -Qt+ivi, 

\Q;1_1+Q!i^2 ai,i + "1,2 ' 

since /o(l) = {a\^\ + ai,2)/a;i(-l) and ai,i -I- a\,2 + ai^s = a;i(-l). 
Similarly the second term in the right-hand side of (|53p equals to 



( , , 0, o)Qo • • • Q,V2. 



Therefore, 



EI[N,\Xt,^\)^ ( , ,0,...,0)(Qo---Q^+ivi+go---Q»V2). (54) 

Vail 4- ai, 2 Q!i,i+"i,2 ' 
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One the other hand, 

eI{N,\Xt, = 2) = El{N,\Ai^i = 2) = e^{Qo ■ ■ ■ Q.+ivi + Qo • • • Q^^2). 
Next since iVo = 1 + ^o.i + ^0,2 + -Bo.i + -Bo. 2, one has that 
EI{No\Xt,=2)=EI{No\Ai^3^1) 

= 1 + e3Qo(l, 1, 0, 1, 1, 0, 0, 0, 0)^ = 1 + e3goV2; 
EZ{No\Xt, = 1) = 1 + ( , ,0,...,o)Qo(l,l,0,l,l,0,0,0,Of (55) 

= 1+ , ,0,...,0 Q0V2, 

\Q!l^l+Q!l^2 + Q;i,2 ^ 

where the second equahty holds due to the special structure of the mean matrix Qo- Note that 

7V_i = Aos + ^0.2 + ^0,3 + ^-1,1 + ^-1,2 + + S_i.2 + C_ia + C_i,2, 
where we mention that if the last step before Ti is { — 1 — > 1}, Ao,3 = 1, otherwise, ylo,3 = 0. 
Similarly as above, one has that 

£;0 (7V_i|Xt, = 1) = ( , , 0, 0) (go(l, 1, 1, 0, 0)^ + O0O-1V2) 

= ( ^I^ ' ,0,...,o)(Qo(l,l,l,0,0,0,l,l,l)^ + Qog-iV2); 

EI{N_^\Xt, = 2) = El{N_Mi.?. = 1) = e3(Qo(l, 1, 1, 0, ...,0)^ + Q0Q-1V2) 

= £;°(7V_i|Ai,3 = 1) = e3(go(l, 1, 1, 0, 0, 0, 1, 1, \f + O0Q-1V2) 
Substituting dM]), dSH) and to one concludes that 

^ = 2 + f:( — — , — — ,i,o,...,o)g....go(i,i,o,i,i,o,i,i,of 



i=0 

00 

,l,0,...,0)Q..-.gi(l,l,l,0,0,0,l,l,lf 

=:nH. 



(57) 



We mention that the purpose of deriving the invariant measure Q{dLj) and the invariant density 
dQ/dP is to prove a law of large number for the (2-2) random walk in random environment by an 
approach known as "the environment viewed from particles" . 

One follows similarly as Zeitouni [7] Corollary 2.1.25 that {ZJ{n)} is stationary and ergodic under the 
measure Q ® P^. Define the local drift at site x in the environment oj as d{x,uj) = E^{Xi — x). The 
ergodicity of {a;(n)} under Q ® P^ implies that: 

-n— 1 -.71 — 1 

-Y,d{Xk,cj) = -^d(0,w(fc)) ™£;Q(d(0,t^)) Q®P°-a.s.. 

fc=0 A:=0 

But 

n n n 

X„ = ^(X,~X,_i) =^(X,-X,_i -d(X„w))+^rf(X„w) 

i—1 i—1 i—1 



=:M„+J2diX,,u;). 



1=1 



25 



Similarly as Zeitouni [7], {M„} is a martingale and P°-a.s., 

lim ^ = 0. 



Therefore 

lim Xr,^EQ{d{0,uj)) Vp. 

Next wc calculate Vp. Note that 



Vp = i;Q(rf(o,w)) = = £;p(n(w)(2c^o(-2) + c^o(-i) + ^o(i) + 2wo(2)))/g(r!) 

i;p(n(t^)(2wo(-2) + t^o(-l) + c^o(l) + 2tJo(2))) (58) 

" E°in\XT, = 1) + £;o(ri|XT, = 2) 

But the denominator in (|58p equals to 

i?p(2 + ( ^i^i , ^ , 1, 0, O) V Oo • • • Q^{2, 2, 1, 1, 1, 0, 2, 2, 1)^) := Er{D{cj)). (59) 

\ai.i + ai,2 ai,i+Q;i.2 ^ 



Substituting to ([58]) one has that 

Ep{n{uj){2ujo{-2) + ujoi-1) + c^o(l) + 2cjo(2)) 
Vp = - 



Ep{D{u:)) 
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